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Von  Neumann's  Comparison  Method  for  Random  Sampling 
from  the  Normal  ar.d  Other  Distributions 


George  E.  Forsythe 
Computer  Science  Department 
Stanford  University 


Abstract 

The  author  presents  a  generalization  he  worked  out  in  1950  of 
von  Neumann's  method  of  generating  random  samples  from  the  exponential 
distribution  by  comparisons  of  uniform  random  numbers  on  (0,1)  .  It 
is  shown  how  to  generate  samples  from  any  distribution  whose  probability 
density  function  is  piecewise  both  absolutely  continuous  and  monotonic 
on  (-*,«)  .  A  special  case  delivers  normal  deviates  at  an  average 
cost  of  only  4.030  uniform  deviates  each.  This  seems  more  efficient 
than  the  Center-Tail  method  of  Dieter  and  Ahrens,  which  uses  a  related, 
but  different,  me'ch"''!  of  generalizing  the  von  Neumann  idea  to  the 
normal  distribution. 
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Von  Neumann's  Comparison  Method  for  Random  Sampling 
from  the  Normal  and  Other  Distributions 

George  E.  Forsythe 
Computer  Science  Department 
Stanford  University 


1.  Introduction.  In  the  summer  of  19^9>  at  the  Institute  for 
Numerical  Analysis  on  the  campus  of  the  University  of  California,  Los 
Angeles,  John  von  Neumann  [3]  lectured  on  various  aspects  of  generating 
pseudorandom  numbers  and  variables.  At  the  end  he  presented  an  ingenious 
method  for  generating  a  sample  frcm  an  exponential  distribution,  based 
solely  on  comparisons  of  uniform  deviates.  In  his  last  snetence  he 
commented  that  his  "method  could  be  modified  to  yield  a  distribution 
satisfying  any  first-order  differential  equation". 

In  191+9  or  1950  I  wrote  some  notes  about  what  I  assumed  von 
Neumann  had  in  mind,  but  I  do  not  recall  ever  discussing  the  matter 
with  him.  This  belated  polishing  and  publication  of  those  notes  is 
stimulated  by  papers  by  Ahrens  and  Dieter  [1,  2]  in  which  several 
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related  algorithms  are  studied,  and  by  a  personal  discussion  vith  the 
authors  on  hov;  the  von  Neumann  idea  can  be  extended. 

In  Section  2  the  general  method  is  presented,  and  in  Section  3 
its  efficiency  is  analyzed.  In  Sections  4  and  'j  it  is  shown  how  the 
exponential  and  normal  distributions  show  up  as  special  cases.  In 
Section  6  the  method  for  a  normal  distribution  is  compared  vith  the 
Center-Tail  method  of  [1]  and  f 2 ] .  In  Section  7  possible  generali7ations 
are  mentioned. 

Although  this  introduction  has  emphasi/.ed  historical  matters, 
the  method  of  Section  6  is  a  good  one,  and  is  competitive  with  the 
best  known  methods  for  generating  normal  deviates. 

I  thank  both  Professors  Ahrens  and  Dieter  for  their  careful 
criticism  of  a  first  draft  of  this  paper. 

2.  The  general  algorithm.  Let  f(x)  >  0  be  defined  for  all 
x  >  0  and  satisfy  the  first-order  linear  differential  equation 

(l)  f'(x)  +  b(x)  f(x)  =0  (0  <  x  <  ®), 


where  b(x)  >  0.  Let 

x 


and  assume  that 


0) 

Then 


e-B(*) 


dx  <  ®  . 


(M  f(x)  =  c'VB'x) 


is  the  unique  solution  of  (l)  vith 


1,  and  hence  f  is 
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the  protab  lity  density  distribution  of  a  nonnegative  random  variable. 


Suppose  we  have  a  supply  of  independent  random  variaoles  u  vith 
l  a  uniform  distribution  on  [0,  l),  and  that  we  wish  to  generate  a  random 

variable  y  vith  the  density  distribution  f(x).  Here  is  one  way  to 
proceed. 

We  first  prepare  three  tables  of  constants  fq^}  ,  fr^}  , 
for  k  =  0,  1,  ....  K,  as  follows.  (K  is  defined  below.)  Let  =  0. 

For  each  k  =  1,  2,  ...»  K,  pick  q^  as  large  as  possible,  subject 

to  the  two  constraints 


(9) 


Gk(x)  =  B(qk  x  +  x)  -  B(qk  l)  (k  =  1,  2 . K). 
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Now  we  present  the  algorithm.  Steps  1  to  3  determine  vhich 
interval  [q^  q^)  the  variable  y  v  1 11  belong  to.  Steps  4  to  11 

determine  t"e  value  ol‘  y  within  that  interval. 


1.  [Begin  choice  of  interval.]  Set  k  4—  1.  Generate  a  uniform 

deviate  u. 

2.  [Test.]  If  u  <  r^,  go  to  step  4. 

3-  [increase  interval.]  If  u  >  r^,  set  k  k  +  1  and  go  back 

to  step  2. 

4.  [Begin  computation  of  j  in  the  selected  interval.]  Generate 
another  uniform  deviate  u  and  set  w  <  ■—  ud^. 

5.  Set  t  Gk(w). 

G.  Generate  another  uniform  deviate  u*. 

7.  [Test.]  If  u*  >  t,  go'to  step  11. 

8.  [Trial  continues.]  [f  u*  <  t,  generate  another  uniform  deviate  u. 

9.  [Test.]  If  u  <  u*,  set  t  <■  u  and  go  back  to  step  6. 

10.  [Reject  the  trial.]  If  u  >  u*,  go  back  to  step  4. 

11.  [Finish.]  Return  y  4—  q^  ^  +  w  as  the  sample  variable. 


We  now  show  that  the  above  algorithm  works  as  claimed.  Since  we 
assume  that  each  .i  <  1,  the  test  in  step  2  must  be  passed  when  k  =  K, 
if  not  sooner.  Hence  an  interval  [q^  q^)  is  selected,  and  the  values 

of  r^  were  chosen  to  make  tne  probabilities  of  choosing  the  various 
intervals  correct. 

Fix  k.  The  remainder  of  the  algorithm  can  be  described  as  follows: 

First,  a  random  number  w  is  selected  uniformly  from  the  interval  0  <  w  <  d  . 

“  “*  K 
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Then  the  algorithm  continues  to  generate  independent  uniform  deviates 

u.  lrom  I’D,  l)  until  the  least  n  is  found  vith 
1 


(10) 


u  J_1  >  u  <  u  ,<...<  u2  <  n.  <  G.  (u) 
n+1  -  n  n-1  3  2  k 


(n  =  1),  or 


(n  >  2), 


With  probability  1  such  an  n  will  be  found,  as  will  be  shown.  If  n 
is  odd,  we  return  y^~ ^  +  w.  If  n  is  even,  we  reject  w  and 
all  the  u,  choose  a  new  v,  and  repeat. 

We  now  determine  the  probability  ?(k,  w)  that  one  w  deternfned 
step  4  will  be  accepted  without  returning  to  step  4.  Let  E^(k,  w) 


i  n 


be  the  universe  of  all  events.  Kor  n  =  2,  3,  . let  E  (k,  w)  be 

n 

the  event 


u  <  u  .  <  .  <  u  <  u  <  G,  (w) . 

n  n-1  3  2k 


Then  tiie  probab;lity  of  ( k ,  w)  is  given  by 


Frob  f K  (k,  w) } 
n  J 


(n  -  1) 

(n  =  2) 


(n  >  3) 
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(n-1)  : 


(all  n). 


The  occurrence  of  (10)  is  the  conjunction  of  E  (k,  v)  and  not- 

n 

En+^(k,  v).  Since  En+^(k,  v)  implies  E^(k,  v),  the  probabi lity 
that  (10)  occurs  for  a  given  n  and  w  is 


(11)  Prob  f h’n ( k ,  w)  and  not-K^(k,  u)}  = 


(n-l)  : 


Gk(w)f 


Summing  over  all  odd  n,  ve  see  that 


(12)  P(k,  v) 


__  y  (VfL  _  v^Ll 

L—  I  (n-l)  :  n  :  J 

odd  n 


-  e  -V*) 


Since  v  <  d,  ,  ve  have 

-  k 


\M  t  Gk(dk)  -  ii(qk)  —  B(qk_1)  <  1. 


v  hence 


(H)  P(k,  w)  "•  e'1  . 


lor  all  k  arid  v. 


Now  dk  '  d?  is  tin  probab:lity  that  w  is  selected  in  the  interval 
?<w5?+d?‘  Oorobining  this  vith  (12),  ve  see  that  the 
probability  that  5  <  v  <  5  4  ^5  and  that  w  is  accepted  is  given 


(lM  Prob  {5  ^  ^  5  4  and  v  is  accepted)  =  e  ^k^  — — 


Corresponding  to  an  accepted  v,  we  return  y  =  q  +  w  as  the 

K*  i. 

sample  variable.  Hence,  from  (lU),  the  probability  that  y  is  in 
tiie  range  x  <  y  <  x  +  dx,  for  given  k,  is 


1 


-Gk(x  •  Vi) 


dx 


1  -B(x)  4  B(qk_1) 

-  e  dx 


by  (9) 


1  B(q  )  1  -B(x)  . 

-  Ce  C  e  x  dx 


f(x)  dx. 


by  (4). 


rr'iat  is, 

(it)  Prob  f  x  <  y  <  x  +  dx  and  y  is  accepted} 


f(x)  dx 

Wi> 


;'ince  this  is  proportional  to  f(x)  dx,  we  see  that  any  accepted  y 
has  the  desired  probability  density  distribution  within  the  interval 
[qk  qk) .  Pince.  i'rom  (15),  the  probability  of  an  infinite  loop 
back  to  step  4  is  zero,  the  second  half  of  the  algorithm  terminates 
with  prohabi  lit.',  1.  This  concludes  the  demonstration  that  the  algorithm 
works  as  claimed. 

5.  Efficiency  of  the  algorithm,  for  a  general  function  b  ,  I 
shall  derive  a  representation  for  the  expected  number  of  uniformly  dis¬ 
tributed  random  variables  u  that  must  be  used  to  generate  one  variable 
y  with  tne  probability  density  proportional  to  f(x).  A  similar  deriv¬ 
ation  is  given  in  [2] . 

The  preliminary  game  to  select  k  --  steps  1  to  5  of  the 
algorithm  —  requires  one  u. 
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The  rest  of  the  algorithm  is  different  for  each  k,  and  ve  shall 


first  determine  the  expected  number  N(k)  of 
To  do  this,  ve  shall  first  assume  that  k  i 
been  picked  in  the  .interval  0  <  v  <  d^. 
2,  and  introduce  the  abbreviations 


steps  to  determine  y. 

s  fixed  and  that  v  has 

Define  E  (k,  v)  as  in  Section 
n'  ’  ' 


(l(i)  en  =  ejk,  v)  =  Prob  (E^k,  v)}  (n  =  1,  2,  ...) 

and 

(17)  g»Gk(v). 

Then,  as  in  Section  2,  we  have  the  following  expression  for  the 
probability  P(k,  w)  of  accepting  w  without  returning  to  step  1+ : 


P(k.  w)  =  (ex  -  e2)  +  (e^.  -  ej  +  (e,-  -  e^)  +  ...  . 

Moreover,  given  k  and  w  and  given  that  w  is  accepted,  the  expected 
number  of  uniform  deviates  u  needed  will  be 


m  (k.  w) 
a 

(l8) 


P(k,  v)"1  ^2(el  -  e2)  + 

—  £f— 

P(k,  v)  odd  ~n  L(n-l)  ! 


-  +  %  -  e()  +  •••] 


Similarly,  the  probability  1  -  P(k,  w)  that  w  is  rejected  is  given  by 


1  -  P(k,  w)  =  (e2  -  e^)  +  (e^  -  e^)  +  (eb  -  +  ...  . 


Moreover,  given  k  and  w  and  that  w  is  rejected,  the  expected  number 
of  uniform  deviates  u  needed  is 
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n>r(k,  v)  =  [1  -  P(k,  w)]"1  [3(e2-e^)  +  5(^-6,-)  +  7(eg-e^)  +  ...] 


Nov,  if  a  w  is  rejected,  the  algorithm  returns  to  step  k,  a 
nev  w  is  picked,  and  the  process  repeats.  Let  M(k,  v)  be  the 
expected  number  of  uniform  deviates  selected  until  a  y  is  finally 
selected,  given  a  fixed  k  and  an  initially  chosen  w.  Then  N(k) 
is  the  average  of  M(k,  v)  over  all  v  uniformly  distributed  on 
0  <  v  <  d,  . 

We  have 


(20)  M(k,  w)  =  P(k,  v)m  (k,  w)  +  fl  -  P(k,  v)]  fm  (k,  v)  +  N(k)]  , 

B  r 


since,  in  case  v  is  rejected,  the  vhole  process  is  repeated.  Using 

the  expressions  (l8)  and  (19)  for  m  (k,  w)  and  m  (k,  v),  ve  get 

&  r 

from  (20)  that 


M(k,  v) 


(n+l)  +  [1  -  P(k,  v)]  N(k) 


=  1  +  eg  +  [1  -  P(k,  v)]  N(k), 
or 

(21)  M(k,  w)  =  1  +  e  Gk^  +  [1-P(k,  v)]  N(k)  . 

Averaging  (2l)  for  0  <  v  <  d  ,  and  using  (12)  ,  ve  find  that 

K 


N(k)  =  1  +  —  r 

^  *'o 


c  (») 

e  dv 


+  N(k)  1  -  -  r 

*k  J0 


,dk  -G.  (v) 
e  dv 
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Solving  for  N(k),  we  get 


(22) 


Finally,  the  expected  number  N  of  uniform  deviates  drawn  in  the 
main  game  unoil  a  y  is  returned  is  the  average  of  N(k)  over  the 
intervals,  weighted  by  the  probabilities  of  selecting  the  various  intervals. 
That  is, 

00 

(2i)  rT  =  N(k)  [rk  -  rR_1] 

k  =  1 


If  we  make  use  of  (i*),  (l),  and  (9)  to  express 


we  obtain  the  ugly  representation 

_B(qk-l^  rqk  B(x) 


.  N  - 


z 


k  =  1 


d.  +  e 
k 


f 


dx 


,.B(v2  r%  ,**>  * 

^Vl 


N  in  terms  of  B(x), 
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I 

1 

1 

1 

j 

3 


4.  Special  case :  exponential  distribution.  If  b(x)  =  1 
in  (1),  then  B(x)  =  x  and  y(x)  =  e”X,  corresponding  to  the  exponential 

distribution  treated  in  [5]  .  For  the  algorithm  of  Section  2  we  have 

-k 

=  k,  d^  =  1,  r^  =  1  -  e  ,  and  G^(x)  =  x,  for  all  k.  Since  d^ 
and  G  (x)  are  independent  of  k,  steps  4  to  10  of  the  algorithm  are 

K 

the  same  for  all  k.  They  can  therefore  be  carried  out  independently  of 
steps  1  to  h  By  (12),  the  probability  that  a  chosen  w  is  not  accepted 
is  1  -  P(k,  w)  -  1  -  e  W  (for  all  k),  and  the  average  value  of  1  -  e  w 
over  0  <  w  <  1  is  e"\ 

If  the  preliminary  game  of  steps  1  to  3  were  played,  the  interval 

-k  -(k+l) 

[k  -  1,  k)  would  be  selected  with  probability  r^  -  r^  ^  =  e  -e  v  - 
p  *"(1  -  e  ■*"),  for  k  =  1,  2,  ...  .  Thus  the  interval  [0,  1)  would  be 
accepted  with  probability  1  -  e  \  and  rejected  with  probability  e 
For  k  -  1,  2,  ...,  if  [k-1,  k)  is  rejected,  then  [k,  k+l)  would  be 
accepted  with  probability  1  •  o  \  and  rejected  with  probability  e  \ 
Sinee  tnc  rejection  ratio  for  eacli  interval  has  the  same  value  e 
which  is  the  a  priori  probability  of  rejecting  in  the  main  game  any  w 
selected  in  step  4,  von  Neumann  could  use  the  rejection  of  w  as  the 
signal  to  change  the  interval  from  [k-1,  k)  to  [k,  k+l).  Thus  the 
preliminary  game  of'  steps  1-3  is  unnecessary  for  the  exponential  distri¬ 
bution.  This  made  von  Neumann's  game  very  elegant.  I  know  of  no  com¬ 
parable  trick  for  general  b(x). 

From  (22)  and  (23),  since  N(k)  =  N,  we  see  that  for  the  expon¬ 
ential  distribution 

(25)  N  =  1  +  I -  =,  - — ■  -  =  4.30026  , 

1  -  e'1  1  -  e'1  * 
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as  stated  in  [1].  There  was  an  error  in  [3]. 


5.  Special  case:  normal  distribution.  If  b(x)  =  x  in  (l), 

_ _  2 

then  B(x)  =  x~/2  and  f(x)  =  yfif*  e  X  ^  ,  corresponding  to  the 
positive  half  of  the  normal  distribution.  For  the  algorithm  of  Section 
2  we  have 

q0  =  s  1*  •  •  • »  Qjj  “  -  1  (k  >  2). 


Hence 


dx  =  1,  -  JT  -  1, 


(k  >  2). 


Also, 


ck(x)  ' 


+  qk-1x  (k  >  1)  . 


The  values  of  r  must  be  computed  from  the  probability  integral.  The 

K 

table  below  gives  13-decimal  values  of  q^,  d^,  r^,  and  N(k)  for  k  =  1, 
2,  ...,  *>(),  as  computed  it.  Fortran  on  Stanford's  I EM  360/ 67  computer 
in  double  precision. 


To  generate  normal  deviates,  one  selects  K  and  prestores  the 
values  of  r^,  q  ,  and  d^  for  k  =  1,  2,  ...,  K.  Then  set  0  and 

d^“"  1.  (The  limit  K  =  12  permits  normal  deviates  up  to  +3*0  to 
be  generated,  and  the  deviates  will  be  truncated  less  than  once  in  a 
million  trials.  A  higher  limit  will  decrease  the  probability  of  trun¬ 
cation.  ) 

As  suggested  in  [2],  one  should  start  the  algorithm  with  a  pre¬ 
liminary  determination  of  the  sign  of  the  normal  deviate.  We  do  this 
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in  steps  Nl-Nj  of  the  following  algorithm.  At  entry  to  Step  N4,  u  is 
a  uniform  deviate  on  the  interval  [0,  l).  The  rest  is  the  algorithm 
of  Section  ,  with  the  sign  appended  in  the  last  step. 

Nl.  [ Begin  choice  of  sign  and  interval.]  Set  k  ^  1.  Generate  a 
uniform  deviate  u  on  [0,  l).  Set  u^“2u. 

N2.  [Test  for  sign.]  If  u  <  1,  set  s  1  and  go  to  step  N4. 

N5.  If  u  >  1,  set  s  4^-  -1,  and  set  u  u  -  1. 

Nh.  [Test  for  interval.]  If  u  <  r^,  go  to  step  N6. 

N5.  [Increase  interval.]  If  u  >  r^,  set  k  k  +  1  and  go  back 

to  step  N4. 

n6.  [Begin  generation  of  |y|  in  the  selected  interval.]  Generate 
another  uniform  deviate  u  on  [0,  l)  and  set  w^-—  ud^  . 
rtf.  Set  t  ^r“Gk(v). 

N8.  Generate  another  uniform  deviate  u*  on  [0,  1). 

N9.  [Test.]  If  u*  >  t,  go  to  step  Nl}. 

N10.  [Trial  continues.]  If  u*  <-  t,  generate  another  uniform  deviate 

u  on  [0,  l). 

Nil.  [Test.]  If  u  <  u*,  set  t  > u  and  go  back  to  step  N8. 

Nil'.  [Reject  the  trial.]  If  u  >  u*,  go  back  to  stop  N6. 

ill  ),  [i  irrish.]  Return  y^— s(qk  ^  +  w)  as  the  sample  normal  variable. 

As  in  Section  7j ,  we  let  N(k)  be  the  expected  number  of  selections 
of  uniform  deviates  in  steps  N4-N13,  as  a  function  of  k.  We  have 
from  (22); 
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1  + 


^k-1 


Numerical  values  of  N(k)  are  given  in  the  table.  Using  the  asymptotic 
formula 


one  can  show  that 

e 

(26)  lira  N(k)  - - - —  «  4.J0Q26  . 

k— 1  -  e'A 

Cf.  (25).  The  equality  (26)  was  written  to  me  by  U.  Dieter. 

I  have  used  the  same  computer  to  establish  tliat 

*  =  21  »<*>  (rK  "  rK-l)  7  3 *03585  , 

k  *  1 

so  that  the  expected  number  of  uniform  deviates  chosen  in  order  to 
generate  one  normal  deviate  is  1  ♦  K  ?  4.05585  . 
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The  correctness  of  this  algoritlim  for  generating  normal  deviates, 
as  well  as  the  value  of  N,  have  been  confirmed  in  unpublished  experi¬ 
ments  by  A.  I.  Forsythe  and  independently  by  J.  H.  Ahrens. 

6.  Comparison  with  the  Center-Tail  method  of  Dieter  and  Ahrens. 

In  [  1] ,  Dieter  and  Ahrens  give  a  related  but  different  modification  of 
the  von  Neumann  idea  for  the  generation  of  normal  deviates.  There  are 
only  two  intervals,  the  center  and  the  tail,  and  the  algorithms  are 
quite  different  for  the  two.  The  expected  number  of  uniform  deviates 
needed  is  near  6.321,  and  computation  of  a  square  root  it>  required  in 
approximately  16  per  cent  of  the  cases. 

The  algorithm  of  Section  3  above  requires  no  function  (all,  but 
its  main  advantage  over  the  Center -Tail  method  lies  in  requiring  about 
two-thlrls  the  number  of  uniform  deviates.  This  should  be  reflected 
in  a  shorter  average  time  of  execution. 

The  Dieter-Ahrens  algorithm  for  the  center  interval  closely  resembles 

my  algorithm  for  each  interval,  and  the  proofs  are  very  close  to  those 

given  above.  The  big  difference  is  that  in  [1]  all  variables  u^  have 

2 

the  cumulative  distribution  function  x  (0  <  x  <  1),  and  the  com¬ 

parisons  n re  of  the  form 


u  ,  >  u  <u,<u„,  <...  <  u.  <uri<u.  . 

n+1  —  n  n-1  n-2  3  i?  1 


In  contrast,  in  this  paper  all  variables  u^  have  uniform  distributions 

and  the  comparisons  take  the  form  (for  the  principal  case  k  =  l) : 

2 


UJ,>U  <u,<u0<...  <u.<u_< 

n+1  —  n  n-1  n-2  3  <? 
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Changing  the  distribution  function  in  [1]  costs  an  extra  uniform  deviate 
and  a  comparison  for  each  u^,  whereas  forming  u^  /2  =  G^w)  in 

Section  5  is  done  only  once  for  each  chain  of  Uj's.  Moreover,  the 
fact  that  u^  /2  is  usually  small  means  that  most  of  the  time 
Ug  >  ux  /2  and  hence  u^  is  accepted  immediately.  This  contributes 
to  keeping  N  low  in  my  algorithm.  Finally,  the  use  of  Gk(w)  makes 
it  possible  to  use  the  von  Neumann  technique  in  any  interval  in  which 
Gk(w)  can  be  eval'iated. 

In  a  more  recent  manuscript  [2]  Dieter  and  Ahrens  have  Improved 
their  C enter -Tail  method  so  that  the  comparisons  are  simpler  and  the 
expected  number  of  uniform  deviates  needed  is  reduced  to  near  5*236. 
According  to  the  authors,  the  improved  Center-Tail  method  is  still  some¬ 
what  slower  than  my  algorithm. 

7.  Further  generalizations.  Let  f(x)  <  x  <  •)  be  the 

probability  density  function  of  a  random  variable  F.  Under  what  con¬ 
ditions  on  f  could  the  von  Neumann  idea  be  applied  to  pick  a  sample 
from  F?  It  is  sufficient  that  the  interval  (^»  ,  •)  be  the  union 
of  a  set  of  abutting  intervals  1^  *  ^qk-l*  ^  =  •••»  “2,  -1, 

0,  1,  2,  ...)  such  that  in  each  closed  interval  either  f(x)  «  0 

or  the  following  three  condition?  all  hold:  f(x)  >  0,  f  is  absolutely 
continuous,  and  f  is  monotonic. 

Then  a  preliminary  game  can  be  played  to  select  an  interval  1^. 

If  b(x)  =  -  f’(x)/f(x)  >  0  in  1^,  the  algorithm  of  Section  2  can 
be  adapted  to  select  a  value  in  1^  with  a  density  distribution  propor¬ 
tional  to  f(x).  (it  may  be  necessary  to  subdivide  1^  so  that  (5) 
and  (6)  hold.) 
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intervals  1^  during  execution,  and  to  evaluate  the  needed 
rk’  ^k’  and  dk*  These  computations  have  to  be  done  only 
once  in  designing  the  algorithm. 

(b)  One  must  evaluate  G^v)  for  arbitrary  w  in  [0,  d^] 
during  each  execution  of  the  algor ithm.  Note  that 


:''i onl;  (l<)  is  done  on-line,  the  success  ol'  an  algorithm  would 
seem  to  depend  only  on  the  ability  to  evaluate  i,n  l'(x)  rapidly.  We 
thus  see  that  having  f(x)  =  C  exp  (  <p  (x))  (and  hence  a  solution  of 
an  equation  of  type  ( l) )  is  of  great  practical  advantage,  but  it  is 
not  essential  in  principle  to  the  use  of  von  Neumann's  idea. 
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